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(57) ABSTRACT 

A centralized product testing system and method for its 
operation are disclosed. The system has a lest application 
server that communicates with remote users as a web-based 
application. Equipment testers login to the system through 
their web browser. They can then run tests while viewing 
instructions for the test and entering results in dynamically- 
generated web browser forms tailored to their test. Com- 
pleted forms (including files generated by test equipment 
tied to a tester's computer) can then be uploaded to the 
testing system. The testing system relates the test data to the 
product under test and stores the data in a relational data- 
base. The test data can then be used to dynamically generate 
preliminary or formal test reports for compliance and other 
purposes. 

The system has many benefits. For example, because test 
procedures, data, and report forms are all centrally stored, 
they can be reliably maintained and quickly updated. Each 
user need only have a working web browser in order to be 
walked through a complicated testing process. The system 
reduces errors and greatly decreases effort as compared to a 
manual system where each tester must create report docu- 
ments individually and manually. 

25 Claims, 6 Drawing Sheets 
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REPORTING SYSTEM ^ ^ rf & of formats using the data m the 

nci n OF THE INVENTION relational database. Finally, test procedures testing 

HELD OF Hh IN VbN iuin ^ templates, and report templates are all centrally maintained, 

This invention pertains to testing covering product com- crea ting a highly standardized process that can be quickly 

pliance. and reliably expanded and revised. 

™,r. rKn;rxrnnw In a first aspect of the invention, a centralized product 

BACKGROUND OF THE INVENTION ^ The system a re l a - 

Many products must comply with standards and/or regu- 10 tional database for storing test data related to multiple 
lations For example, electronic computing equipment must pro ducts. It further comprises a central electronic repository 
meet a variety of electrical safety standards, electromagnetic for storing test templates and report templates in electronic 
interference standards, and equipment compatibility stan- form. It also comprises a test application server that allows 
mtene a remote user with a web browser to access the testing 

mmsmm 

the tests are comple e, the recorded results irom Preferably, the test application server comprises a 

Compliance testing has traditionally been a time- compat ible forms, test templates from the 

consuming process. Testers must have a mastery ol me ^ electronic repos itory, and test data from the relational 

current applicable standards and testing procedures, ine database 

tester (or someone else charge ^^^^fo Inano iher aspect ofthe invention, a method of automating 

complete, preparation of a typical final report can take Test results are accepted from a user as 

weeks. indicated by the user on the test forms. The test results are 

SUMMARY OF THE INVENTION parsed into a relational database. 

J . . w ♦ • In vet another aspect of the invention, a related method of 

In addition to the problems with traditional WjijJ- 35 n ^ prod uct testing and reporting is disclosed. In this 

tified above, today's fast-paced global marke has oomph- stomal g P b ^ fc ^ tQ 

cated the testing puzzle. Now many products must m t application server by supplying dynamically 

standards in different countries, each requiring a separate web-browser test forms from the central server to 

report in a separate report format. Short product life-cydes ^""^^^ and accepting test data indicated 

make compliance testing delays costly, and place a demand- 40 testers ^ ^ fay the testers ^ e accepted 

ing load on test personnel. data fc &tored in a central relational database. User 

In contrast to the traditional distributed and highly manual sts for product test rep0 rts are then filled by locating 

compliance testing process, the present invention involves a ^ ^ for ^ pfoduct ^ tfae centfal relationa i database 

centralized testing system (although the testers themselves & rf t late using mat test data, 

may remain distributed). In one embodiment, a central 45 

electronic repository houses information on testing proce- brief DESCRIPTION OF THE DRAWING 

Se" tit ^£oZ^u Ci s. A test appli- disclosure with reference to the drawing, wherei. 

cation server coordinates the central electronic repository 50 FIG. 1 illustrates an overall hardware configuration lor a 

and the database with a web server application, allowing tesling sysie m according to the invention and its networK 

remote users to use their web browsers to select a test, view connection; 

and follow test procedures tailored for their equipment and pIG 2 shows an overall logica i configuration for a testing 

their test, upload results from the test into the relational system according to the invention; 

database, automatically view those results, and create dif- 55 piGS 3 4 ^ amJ 6 illustrate web browser output taken 

ferent types of final reports from those results with a tew ^ fo ^ different points in the testing system output for an 

keystrokes on their computer. embodiment of the invention; and 

The present invention has many advantages when com- ^ ^ illustrates the web-based dynamic test form cre- 

pared to traditional compliance testing. It guides users ■ for ^ embodimenl of t he invention, 

through a complicated testing process using a familiar 60 P 

web-browser environment. It provides users with links to DETAILED DESCRIPTION OF THE 

detailed instructions and standards that further aid a user in PREFERRED EMBODIMENTS 

performing high-quality tests. It allows users to direct y described below with reference to a 

upload data from 65 ^^S^^i^i^^^Q^ 

the relational ^^ u ^ f ^^^^^ SagT(SQL) for database manipulations, Hypertext 



09/30/2003, EAST Version: 1.04.0000 



US 6,442,714 Bl 

3 4 

communications, and Practical Extraction and Report Lan- or obviously erroneous data. Assuming the data fields were 

guaee (Perl) for most other system tasks. Those skilled in the filled properly, the server creates a new record in the 

art will recognize that alternate ways of implementing the relational database. The new record contains the job infor- 

describedfealures are possible with these languages, as well mation and relates the reserved job number to the job 

as with other software languages. 5 information supplied. 

^ • Once a job has been created m the database, users can 

System Configuration access tfaat ^ M tests and lcst information t0 that job, and 

FIG. 1 shows an overall hardware configuration for one yiew in f ormat i on f or tests already related to that job. To 

embodiment of the invention. Test application server 20 and perform these functions, users input a job number into the 

database server 22 are physically separate computers elec- JL § home page 5 q at D0X 52 a nd select one of the links 
tronically linked by data connection 24. Test application 10 "jest Initiation", "Test Execution", or "Test Report Comple- 

server 20 has a data network connection 26 to data network {ion". 

28, which may be a local area network or a wide area Test initiation By following the fink "Test Initiation", 

network. Note also that data connection 24 may be formed Users may complete a pre-test plan or add data common to 

by connecting both servers 20 and 22 to data network 28. a ll tests. The "Test Initiation" link calls a page with a 

Users access the test application server by running a web 15 sequential list of all the steps that must be completed prior 

browser on a personal computer, workstation, laptop to testing. The "New Account" function and the "New Job 

computer, etc. connected to data network 28. The computer Number" functions from the home page are available on this 

may be completely separate from any test equipment, like page. The "Test Initiation" page also contains a link to a Test 

computer 30, or may be interfaced with test equipment, like Assessment Plan that contains a series of forms used to 

computer 32 and test equipment 34. In some instances, a 20 collect and distribute the user's test planning information, 

single machine may integrate both the test equipment func- This test plan information can then be critiqued by other 

tion and the web browser function. engineers to insure the intended test setup and tests to be 

FIG. 2 shows the logical configuration of the embodiment performed are correct and appropriate, 

of FIG l. Application core 40 resides on the test application The last set of links on the "Test Initiation" page help the 

server and performs most of the "work" of the system with user to add samples, chassis, configurations, modes, and 

Perl scripts. Core 40 is connected to peripheral functions 46 cable arrangements into JLS. This data is usually referenced 

and 48. Database interface 46 performs database extract and multiple times during the testing process. Once this data is 

store operations with relational database 42, which resides entered, the user can refer to it during testing by simply 

on the database server. Web interface 48 (e.g., a web server) 3Q clicking a checkbox or radio button, 

transmits web pages to users and receives uniform resource Test Execution 

locator requests back from those users. Finally, application Users add tests to a job, or rejoin a pre-existing test by 

core 40 is connected to a template repository 44 that contains following the link "Test Execution". The link calls a Perl 

test templates and report templates. Repository 44 may, e.g., script with the job number as a parameter. The script creates 

store each template as a separate 1 file in a disk folder. 35 a web page such as the example web page 60 shown in the 

Using the Testing System browser window of FIG. 4. This web page is sent to the 

A user accesses a testing system home page from within user's browser. It allows the user to select a new test and 

their web browser in order to use the system. FIG. 3 shows relate it to the job, or to rejoin an existing test related to the 

a typical home page display 50 for an embodiment named job. The page also displays the tests already related to that 

the "Job Log System", or JLS. The home page contains 40 job. Once a test is selected, the user is prompted to enter 

selections for major JLS functions and links for obtaining information describing the test— information about samples, 

JLS accounts and job numbers. chassis, configurations, modes, and cable arrangements for 

Preferably access to the testing system beyond the home the product under test and other equipment linked to the 

page is limited. Access is controlled in JLS by issuing product to create a test environment. This information is 

accounts, and requiring users to login to the system before 45 linked to a test details number and the job number and then 

accessing test data. JLS maintains an account for each user, saved in the relational database. 

with the account tracking the user's name, phone/pager A user may also select previously initiated tests for 

numbers, testing discipline, business unit, and location. JLS execution. FlG.^shows a web page, comprising three 

has the capability to verify and/or update account informa- frames 70, 72, 74, that is sent to the user for one specific test, 

tion by accessing a personnel database on a separate server 50 Frame 70 contains general instructions and links to detailed 

(not shown). test procedures. Frame 72 contains links to Perl scripts that 

Once a user has an account on JLS, they may login to the step a user through this particular test procedure. Frame 72 

system and conduct testing. The first step in a new test also contains a link to a Perl script that allows a user to 

program is obtaining a "job number" that can be used to preview a report containing the test data for their test, as 

identify the product under test. In JLS, a user selects the link 55 entered in the relational database so far. 

"Get a New Job Number" from the home page displayed on Each Perl script linked to one of "Test Details", "Test 

their browser in order to request a new job number. The test Equipment", "Test Conditions", "Confidence Check", "Test 

application server receives this request, reserves an unused Results", "Photograph", and "Final Results" in frame 72 

job number, and sends a browser form, requesting informa- creates a web browser-compatible form corresponding to a 

tion about the job, to the user's browser. Job information 60 part of that test. For instance, the "Test Equipment" displays 

includes a name for the responsible engineer, the product a list of available test equipment, along with check boxes 

name, product code name, discipline of the product, the that lets a user select test equipment. The Perl script gener- 

numb'er of configurations tested, and any comments. ating this page may query the database as to the user's 

When a user fills in the requested job information and location, and only display a list of test equipment at that 

sends a request to the web server, the test application server 65 location. 

receives the filled-in web form data values, parses the data As the user completes each form, the data entered is sent 

values, and checks mandatory fields of the form for missing back to the test application server to be parsed and checked 
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by another script. Note that some forms allow a user to send 
test data generated by an identified piece of test equipment 
in that equipment's result format, to be parsed by a script 
designed to read that format. 
cTest Report Completion^ 

A user can request that the system create reports for a 
product based on the test data existing in the database. The 
user can access the "Test Report Completion" link from JLS, 
running a script that creates a browser form such as browser 
form 80 of FIG.-6. The form shows each test related to the 
job number, along with check boxes for each. A user 
requests a report by selecting check boxes for the desired 
tests, and then selecting a desired output format (form 80 
shows only one format, an Adobe Framemaker Report). 
Other forms allow a user to choose one of multiple output 
formats, such as HTML or Rich Text Format (RTF). Some 
forms also allow a user to select one of several "looks" for 
the report, e.g., a first look for a domestic certification 
organization and a second look for a foreign certification 
organization, using the same test data. 

^Detailed System Operation^. 

The test application server is configured to respond to user 
requests entered with their web browser. Server operation 
for a typical user request is as follows: 

A user selects a link or button on a test system-generated 
browser form. The user's web browser sends a correspond- 
ing request to a web server application running on the test 
application server, i.e., step A in FIG. 7. For instance, the 
request may contain the uniform resource locator (URL) 

http://-JLS/jobtest/emc_test.pl?emc_test__page=burst/ 
burst_report.html&job_number=430&old_job_ 
number~430&test_details_number«1367 

The file "emc — test.pl" is a Perl script located on the test 
application server. The web server runs this script as step B 
in FIG. 7. The information after the "?" in the URL above 
is converted to a series of command-line parameters and 
passed to the script. For instance, the parameter "emc_test__ 
page" has a value "burst/burst_report.html"_the location of 
an HTML template file to be used to build the requested 
pageV The parameter "job_number" has a value "430", and 
the parameter "test details_number" has a value "1367" — 
these values identify the job and test that are to be accessed. 
The job number and test details number get set by a user on 
previous web forms, and are then passed from form to form 
to be automatically included in URLs. 

In step C, the Perl script opens the -HTML template^ file 
"burst/burst— report .html" on the test application server file 
system. In step D, the Perl script reads each line from the 
HTML template file and examines its content. If the line 
contains a placeholder of the style 
<text filling instructions 

the script replaces this placeholder with information 
obtained by interpreting the instruction. For instance, if 
instruction has the value name="test — details — number", 
the script substitutes the value it received on the command 
line (1367) for the placeholder. 

Once placeholder values have been substituted if 
necessary, the script sends the modified line from the HTML > 
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40 



50 



has a pseudo-SQL instruction imbedded in the parentheses. 
The Perl script extracts this database instruction and replaces 
$job_ number with the value passed to the Perl script (430), 
The resulting SQL instruction 

select product_ name from job where job-number=430 
is passed in step D.l to the database server. The database 
server executes the SQL instruction using the test system 
relational database, and passes the matching data back to the 
Perl script in step D.2. The Perl script substitutes this 
matching data for the placeholder and continues with step E. 

Placeholder tags can be used for a variety of functions. 
For example, they can be used to create HTML tables with 
a <table filling instruction> command. They can be used to 
add to the list of parameters already received in the URL 
request with a <variable filling instruction>command. They 
can be used to create a series of check boxes, such as boxes 
82 and 84 in FIG. 6 or radio boxes from within a table filling 
command by selecting string values within an sql statement 
that produce those HTML elements. Other HTML controls 
can likewise be dynamically placed in a test form in similar 
fashion. Appendix A contains an example of a complete 
HTML test template illustrating several placeholder tag 
types. This template is used to send data to a data-storing 
script. Appendix B contains as an example a Perl data- 
storing script that interprets data sent with this template by 
a user, and then stores it to a database. Appendix C contains 
an example of a Perl template -filling script. Various low- 
level functions common to these and other system scripts are 
implemented in a function library (not shown), as is com- 
mon in the computer programming art. 

Although test reports can be generated in HTML format 
using the steps described above and illustrated in FIG. 7, 
formal reports typically use a document or word processing 
format, such as the Adobe Framemaker format, or Rich Text 
Format (RTF). 

A test report in a document or word processing format can 
be generated in a manner similar to the one shown in FIG. 
7. But instead of an HTML template, a test report template 
that follows the desired output format is opened. The tem- 
plate can contain placeholder tags similar to those in the 
HTML templates, although the placeholder tag delimiters 
may be different (e.g., instead of "<" and ">"). 

The output stream of a Perl script generating a test report 
may differ from FIG. 7 also. The output stream can be 
directed to a file in a central file system, or it can be directed 
back to the user's browser (in which case the user must save 
it on their file system unless the browser has a plug-in 
supporting that format). 
Test System Administration 7 

One of the greatest advantages of the present invention is 
that it allows test data collection and test report generation 
by a large number of testers to be centrally administered in 
a large organization. This creates uniformity across the 
organization, removes inefficiencies in duplication of efforts, 
and allows test procedure and reporting changes to be 
quickly implemented. Software updates and data backups 
are also confined to a central location. The system also 
integrates helpful information with test instructions, allow- 
ing testers access to a wealth of information during the 



template file to the web server application in step E. The web 60 testing process. And by interpreting output generated by test 



server sends the information back over the network to the 
user's web browser in step F. 

Many of the placeholders in a typical test system HTML 
template file contain database requests. For instance, the 
placeholder 

<text filling (select product_name from job where job_ 
number=$job_ number)> 



equipment and uploaded through a user's web browser, the 
system avoids errors typically seen with hand-copied results. 
Finally, the system allows multiple users to access test data 
and generate reports, automatically, in a format of their 
choosing. 

System administration is responsible for maintaining the 
user database, the test data relational database, and the test 
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application server and its ac Jmp any ing script and template 10. A method of automating a ^ produc t testing and 

files. New features are typically added to the system by reporting, process comprising the steps of. 

modifications to the template files and the addition of new guiding a user through the testing process by dynamically 

template files to cover new tests. generating test-specific web-browser compatible test 

After reading this disclosure, one of ordinary skill in the 5 forms ^ gtep me usef lhroug h me process and send- 

art will recognize that many advantageous modifications to ^ {q ^ web browser; 

^T^t^"^VZSl acceptingtestresul^cntheusenhroughtheuser'sweb 

relational database, script files can dynamically create forms browser; and 

and reports using other applications, e.g., by taking tabular 1Q p ar5m g accepted test results into a relational database, 

data from the database and feeding it to a graphing n ^ method of cla j m io, further comprising the step 

application, statistical application, or a similar program that ^ f raling a report m a selectable format using test results 

ZZS^E^S^^Z^ storedintherdationaidatabaseaodacentraUy-s^d^ort 

M ^ememodofc^^^^^^ 

Son as claimed. cally generating test-specific web-browser compatible test 

What is claimed is: forms comprises the steps of: 

1. A centralized product testing system comprising: accessing an electronic web form template having place- 
a relational database for storing test data related to mul- holder tags containing embedded relational database 

tiple products; 20 requests; and 

a central electronic repository for storing test templates fi ^ placeholders in the template by issuing the 

and report templates in electronic form; relational database requests to the relational database. 

a test application server that allows a remote user oper- ^ ^ memo d of claim 10, wherein the sequence of the 

ating a web browser to interface with the testing f ated is at leasl partiaU y dependent on the 

system, the server having the capability to store test 25 * ^ ^ ^ 

data entered by the user on web-browser compatible ans ^ PP ^ 7 f ^ the questions asked 

testing forms into the relational database and the capa- ^ least partially dependent on the answers 

bility to dynamically generate product test reports in * * ^ ^ 

multiple selectable report formats, based on report J claim 10> comprising the step of 
templatesfrom the central electronic repository and on 30 resemingalistoftestequipmenttotheuser)fromwh ichthe 

selected stored test data. , lest equipmenl for a desired test. 

2. The centralized product testing system of claim 1, ^ ^ q£ claiffl 15> wherein the ^ of test 
wherein the test application server comprises a test form . Qt displayed t0 the user is a sub-list of a master list, 
generator that dynamically produces web-browser compat- H sub-list corresponding to equipment, from the master 
ible test forms based on user input suppl ed on other 35 tha , ^ availab ^ at t tf e user's location, 
web-browser compatible forms, test templates rrom the ^ ^ rf J() thf , me(hod further 
central electronic repository, and test data from the relational axa ^ a controlling use of the system by requiring users to 
database. obtain and use an account. 

3. The centralized product testing system ot claim L The method of claim 17, wherein account information 
wherein the test application server comprises a test result 40 • ^ ^ ^ obtaine d from a separate 
uploader that accepts test input as indicated on one of the nne , database 

web-browser compatible testing forms by a user, parses the V ^ ^ ^.^ ^ ^ {ype of product 

test input, and stores the parsed input in the relational ^ associated to a specific j ob identifier within the relational 

database. database 

4. The centralized product testing system of claim 3, 45 ^ rf ^ ^ each ^ ^^^j 

wherein the test result uploader accepts, as test input, results a s ific type of prod uct is associated to that product's 

produced by an identified piece of test equipment m hat or a spe yp ^ 

equipment's result format, and parses that result format into J ^ rf ^ 1Q wbeR;in during , he presen . 

a format compatible with me relational database q b . browser ^p^e te st forms to a user, the 

5. The centralized product testing system of claim , 4, 50 ^ ^ ^ ^ web . browser ^ t0 d6taile d 
wherein the equipment's result format is columnar text data. m d and/or standards corresponding to those test 

6. The centralized product testing system of claim 1, ^rms 

wherein the test application server comprises a report gen- ^ method of claim 10> wherein the step of accepting 

erator that dynamically produces '^^s based on ^ user ^ ^ ^ fof missing of efro . 

requests entered on w ^ 0 ^ ^XlT t t re£nal neous entries, and prompting a user if a problem is encoun- 

from the template database, and test data from the relational ^ 

database. . 23 The method of claim 10, wherein multiple centrally- 

7. The centralized product testing system of claim 1, ^ saffle ^ fesults from the 
wherein the relational database resides on a database server ^ p dalab J e 

physically separate from the test application server. 60 M Amethod 0 f automating product testing and reporting, 
8 The centralized product testing system of claim 1, 

hardware testing equipment operated by a remote user. indicated on the web-browser test forms by the testers, 
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storing the accepted test data in a central relational 
database; 

responding to user requests for a product test report by 
locating test data for that product in the central rela- 
tional database and rilling a report template using that 
test data. 



10 



25. The method of claim 24, wherein multiple testers can 
provide test data related to the same product to the central 
server, and wherein test data provided by multiple users can 
be combined in a common report. 
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